Sound reproducing array processor system

ABSTRACT

A method and apparatus for dynamic, adaptive mapping of three-dimensional aural phenomenon to a two-dimensional sound reproducing surface. The surface is comprised of sound pixels that are discrete, addressable output locations. Actual or synthetic recorded audio material is decomposed into discrete sound sources which are then mapped to the sound pixels. This mapping occurs during the production phase by means of computer-aided design (CAD) system. The CAD system guides the sound designer in the implementation of complex acoustical designs by automating the most complex and computationally intensive functions. The mapping function can be extended to integrate real-time human interaction, ultimately creating a participatory, interactive virtual sound environment.

This is a division of application Ser. No. 08/166,463, filed Dec. 14,1993, now U.S. Pat. No. 5,517,570 which application is incorporatedherein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates in general to multi-channel audio production,editing and playback systems.

2. Description of Related Art

As with light sources, sound sources possess a spectral signature.Recent research has revealed the non-periodic nature of many acousticalwaveforms, despite the preponderance of observable fundamentals andharmonics. The spectral signatures of real-world sound sources have beenshown to change over time, particularly when it is viewed in terms ofdecay and reflection through boundaries. However, current soundreproduction systems have proved inadequate in the characterization ofsound sources which are, by nature, dynamic entities.

With the continuing evolution of digital audio technology, breakthroughsseem to be commonplace in sound reproduction methods. In truth, however,it is not really possible to introduce real innovation into audioentertainment without controlling the recording/playback chain. This isquite significant since it is well known in high-end consumer audiocircles that the truly difficult task in the design of audio equipmentis not the creation of sound stage depth, but rather, the realistic andaccurate preservation of horizontal and vertical location of objects andevents.

Careful attention to the phase response of the reproduction chain can domuch to resolve the perceived depth of a recording. The "distance back"aspect of reproduction requires the preservation of very subtle timingrelationships within the recorded material, often as small asmicroseconds. As a design task, this is less difficult to execute thanto project the more complex and subtle cues that convey XY planelocation and "vaulting" ambience. The accurate re-creation of the trueambient "feel" of a real-world sonic event requires the neutral transferof a great amount of information, i.e., electronically encoded cuesthat, when replayed, provide the illusion of "liveness".

The preservation of the subtle minutiae that convey accurate spacing andsize of the recorded events is also important. In a channel reproductionsystem, this is exceedingly difficult to do. On the production side, theillusions of XY plane location, and even size and space, are projectedby means of ingenious but often tortuous production techniques. Forexample, the continued development of surround sound technology extendsand enhances these methods. Still, these techniques are attempts toameliorate problems inherited from earlier, more primitive technology.In any case, the efforts are largely wasted in that the vast majority ofvenue playback systems lack even rudimentary elements of good sonicdesigns.

SUMMARY OF THE INVENTION

To overcome the limitations in the references described above, and toovercome other limitations that will become apparent upon reading andunderstanding the present specification, the present invention disclosesa method and apparatus for a dynamic, adaptive mapping ofthree-dimensional aural phenomenon to a two-dimensional soundreproducing surface comprised of sound pixels that are discrete,addressable output locations. In the present invention, actual orsynthetic recorded audio material is decomposed into discrete soundsources which are then mapped to the sound pixels. This mapping occursduring the production phase by means of computer-aided design (CAD)system. The CAD system guides the sound designer in the implementationof complex acoustical designs by automating the most complex andcomputationally intensive functions. The goal of this system is maximumflexibility and power for experienced audio engineers, while maintainingan high standard of useability. In more advanced implementations, thepresent invention extends the mapping function to integrate real-timehuman interaction, ultimately creating a participatory, interactivevirtual sound environment.

BRIEF DESCRIPTION OF THE DRAWINGS

Referring now to the drawings in which like reference numbers representcorresponding parts throughout:

FIG. 1 is a block diagram illustrating the basic components of thepresent invention;

FIG. 2 is a dataflow diagram that further describes the functions of thecomputer-aided design (CAD) system in the present invention;

FIG. 3 is a block diagram illustrating the components of the soundreproducing surface and its electronics, wherein playback occurs in astatic mode;

FIG. 4 is a block diagram illustrating the components of the soundreproducing surface and its electronics, wherein playback occurs in astatic mode with responsive inputs;

FIG. 5 is a block diagram illustrating the components of the soundreproducing surface and its electronics, wherein playback occurs in adynamic mode with responsive inputs and real-time audio;

FIG. 6 is a block diagram illustrating the components andinterconnections of a plurality of sound reproducing surfaces;

FIG. 7 is a block diagram illustrating the components of a static soundpixel using global digital signal processing;

FIG. 8 is a block diagram illustrating the components of a dynamic soundpixel using local digital signal processing;

FIG. 9 is a block diagram illustrating the components of a satellitenetwork for sound pixels;

FIG. 10 is a block diagram illustrating the components of a satellitesound pixel with analog signal processing;

FIG. 11 is a block diagram illustrating the components of a satellitesound pixel with analog signal processing;

FIG. 12 is a block diagram illustrating the components of a satellitesound pixel utilizing digital processing and having a MIDI interface;

FIG. 13 is a block diagram illustrating the components of a satellitesound pixel utilizing digital processing and having analog output toother satellite sound pixels;

FIG. 14 is a block diagram illustrating the components of a satellitesound pixel utilizing digital processing and having digital output toother satellite sound pixels;

FIGS. 15A-15D are block diagrams illustrating various perspective viewsof a sound bubble constructed according to the teachings of the presentinvention;

FIGS. 16A and 16B show the left panel and right panel of the soundbubble;

FIG. 17 shows the rear panel of the sound bubble;

FIG. 18 shows the top panel of the sound bubble; and

FIG. 19 is a block diagram of the electronic components used to controlthe operation of the sound bubble.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

In the following description of the preferred embodiment, reference ismade to the accompanying drawings which form a part hereof, and in whichis shown by way of illustration a specific embodiment in which theinvention may be practiced. It is to be understood that otherembodiments may be utilized and structural changes may be made withoutdeparting from the scope of the present invention.

Overview

FIG. 1 is a block diagram illustrating the basic components of thepresent invention. The present invention is intended to haveapplications in several markets, ranging from special venueentertainment markets such as video arenas and theme parks, to morecommonplace markets such as concert halls, theatres and video games. Inthe present invention, a two-dimensional planar surface 10 comprised ofsound reproducing elements called sound pixels 12 is used to reproduce3-dimensional aural phenomenon. Like pixels in visual imaging systems,the sound pixels 12 together produce an "aural image" or "sonictapestry". The sound pixels 12 each comprise a discrete, addressableoutput location, wherein audio material is decomposed into a pluralityof discrete sound data streams that are mapped to the sound pixels 12.

The data streams that control the sound pixels are created using acomputer-aided design (CAD) system 14 that guides a sound designerthrough the modeling of the acoustical playback environment. The CADsystem 14 is used by the sound designer to create a virtual acousticalenvironment (VAE) modeled on the actual acoustical environment, of theplayback venue to automate the capture or creation of propagatingacoustical energy within the modeled environment, and to transform thiscaptured acoustical energy into digital data streams for playbackpurposes. The CAD system 14 allows the sound designer to simulatereal-world ambience and re-create the tangible events that form thebasis for spatial perception of sound. Physical conditions associatedwith the VAE, including temporal and spectral characteristics, can bemodeled by the CAD system 14.

Audio material is "painted" onto a digital representation of the soundreproducing surface 10 in the CAD system 14, rather like an artist laysbrush strokes on a canvas. Another way to look at the present inventionis as a discrete-time digital sound stage, wherein the sound designerassumes the role of stage director, placing objects in areas on a stageand orchestrating their interaction. Moreover, the CAD system 14re-creates the interaction of multiple sound objects with one another,so that the additive nature of real-world sonic waveform interaction canbe reproduced. Thereafter, the sound objects can be propagated throughthe VAE to represent changes in location for the sound producing entity.Once location and movement of sound objects within the VAE has beenspecified, the audio material is compiled and placed in a high densitystorage device 16, such as a hard disc drive or optical disc. The audiomaterial typically comprises discrete data streams that are mapped ontoor assigned to the sound pixels 12. The CAD system 14 creates thedigital data streams for the sound pixels 12 with the samecharacteristics of real-world sound events in a real environment.

During playback, the data streams created by the CAD system 14 areretrieved from the storage device 16, processed, and then transmitted tothe sound pixels 12 to reproduce a 3-dimensional aural phenomenon. Eachsound pixel 12 contains a full range audio transducer that reproducessound energy under control of the data streams. The playback of theaudio material can be accomplished in either static or dynamic modes.

In static mode, the data streams that comprise the audio material are"static" in that it is not altered once completed. The operator simplyactivates the playback system 18 and the audio material is replayedthrough the sound reproducing surface 10, possibly in synchronism withan accompanying video program. Sound objects can move through space andlocations during playback by the data streams sequentially addressingdifferent pixels 12 in the surface 10. In dynamic mode, the presentinvention extends the implementation of static mode to include real-timeinteraction, thereby creating participatory sound environments.

Computer-Aided Design System

FIG. 2 is a dataflow diagram that further describes the functions of thecomputer-aided design (CAD) system 14 in the present invention. Thesound designer first creates a graphical representation of the VAE. Thisis accomplished in a manner similar to prior art CAD systems byspecifying dimensions, characteristics and parameters describing theVAE, including information relating to the perspective of the audience.These values may be specified by selecting values from a library ofvarious acoustical characteristics such as reflection and absorption, orby selecting environments from a library of VAEs such as "listeningrooms," "theaters," "concert halls," or other typical acousticalenvironments. In addition, these values may be derived empirically, forexample, by sampling the frequency response of a similar space over timeand frequency. The values specified for a VAE form the basis of thecomputations performed by the CAD system 14 that result in the datastreams used to control the sound pixels in the sound reproducingsurface 10.

The CAD system 14 of the present invention comprises an operating systemand user interface 20, application modules 22-38, and system discmanagement module 40. The operating system and user interface 20 acceptsvarious types of data, including user input, SMPTE time codes, and MIDIdata. The operating system and user interface 20 also interacts with theoperator and displays various information on a screen.

Initially, the operator specifies various parameters describing the VAEand the playback system. Model parameters identify the characteristicsof the VAE, and are augmented by detailed information on the scenedimensions and features. Array features specify the configuration of aparticular playback system. Venue features are provided to describecharacteristics of the playback venue.

Application module 22 is used by the operator to modify the VAE model.In the preferred embodiment, the VAE model can be configured in a numberof ways, for example, analytically or empirically. The VAE model mayinclude standardized parameters from a look-up table of previouslystored or standardized VAE models. The look-up table may includenumerous references to acoustical properties of spaces and materials.

Application module 24 is used by the operator to manage MIDI data inputthe CAD system 14. Typically, application module 24 generates MIDI-basedlocation data and MIDI-based effects for use within the VAE.

The VAE model is used by application module 26 to transform parameterssuch as the scene dimension and scene features into an acoustical model.The application module 24 can display a visual representation of thisacoustical model for the operator.

Application module 28 accepts parameters for sound pixel array featuresand venue features to generate data representing venue acoustics andarray geometry/dimensions. The array geometry/dimensions describe theconfiguration of the venue surfaces, which can be flat or circularsurfaces, so that the acoustical energy can be accurately mapped ontothe sound pixels 12. In addition, the geometry/dimensions describe theprospective of the audience in the venue. Venue acoustics may representthe frequency responses of the various materials in the venue.

Once the VAE is modeled to the satisfaction of the operator, soundobjects can be placed and manipulated within the VAE. Application module30 provides the general functions for managing sound objects. Forexample, when creating a new sound object, the application module 30accepts data representing the object features, object movement, objectlocation and duration.

Application module 32 manages the time base for all activities in theVAE. For example, all movement and action of sound objects in the VAEare identified by a time line reference. Application module 32 alsoaccepts SMPTE time codes to synchronize the sound objects to externalevents. Application module 32 produces virtual time increments for useby other modules in synchronizing and referencing activities within theVAE.

Application module 34 translates the acoustical model into the DSPcoefficients and programming necessary to drive the sound pixels. TheseDSP coefficients and programming include filter coefficients, 2nd ordereffects, and delay coefficients. Application module 34 uses the venueacoustics and geometry/dimensions to achieve this function.

Application module 36 manages the location of sound objects in the VAEusing location data from application module 30, virtual time incrementsfrom application module 32, and MIDI-based location data fromapplication module 24. Application module 36 produces object virtuallocation data which is used to modify the delay coefficients.

Application module 38 is used to place sound objects in the ambience ofthe VAE, i.e., it maps sound objects to sound pixels 12 in accordancewith the time line reference indicated by the virtual time increments.Application module 38 accepts filter coefficients, delay coefficients,2nd order effects, virtual timing increments, object virtual locations,sound objects, and array dimensions to perform these functions.Application module 38 transforms this data to create PCM data for thesound pixels, which is stored as discrete data streams for laterretrieval by system disc manager 40. System disc manager 40 alsoretrieves sound objects from storage for manipulation by applicationmodule 38.

Sound Reproducing Surface

FIG. 3 is a block diagram illustrating the components of the soundreproducing surface 10 and its electronics, wherein playback occurs in astatic mode. In static mode, the energy dispersion profiles and objectlocation parameters assigned by the CAD system 14 are fixed and do notrespond to changes in real-time conditions. Static mode provides abare-bones embodiment of the present invention, wherein the focus is onsolving the basic system problems, providing a solid foundation forother embodiments, and yet creating very sophisticated soundreproduction.

The sound reproducing surface 10 has a plurality of addressable soundpixels 12, typically comprising audio transducers arranged in L columnsand K rows. The pixels 12 are coupled via bus 42 to digital and audioand control signal drivers 44. A time code generator 46 is coupled tothe drivers 44 as well as a digital audio storage device 48, which canbe any commercial device for storing the data streams such as a CD-ROMor a hard disk. The data streams are read from the digital audio storagedevice 48 and passed to the drivers 44 to control the operation ofpixels 12. Preferably, the drivers 44 transmit digital audio signals tothe pixels 12 in AES/EBU format and transmit control signals to thepixels 12 in RS485 format. The time code generator 46 provides areference clock to both the drivers 16 and the storage device 18 forsynchronizing the transmission of the data streams to the pixels 12. Thepixels 12 decode and amplify the digital audio signals in accordancewith the control signals. Essentially, the sound pixels 12 provide adistributed active speaker array with integral digital-to-analogconverters.

The sound reproducing surface 10 is preferably deformable and thus thesound pixels 12 can be arranged into any 2-dimensional or 3-dimensionalconfiguration. In some high-end video venues, the surface 10 may becurved in an arc of 270 degrees or more to correspond to the curvatureof a screen. In other applications, such as in theme parks, the surface10 may curved into a spherical shape. On the other hand, someinstallations may only need a surface 10 with a flat, planar shape. Thepoint is that playback architecture is flexible enough to accommodate awide range of requirements.

The number of sound pixels 12 comprising the sound reproducing surface10 are also flexible. As with an imaging system, the larger the numberof energy producing elements, the greater the resolution of thereconstructed "image." In the present invention, some applications mayrequire only a small number of pixels 12, while other applications mayrequire large numbers of pixels 12. Typically, the number of soundpixels 12 will not be a function of physical constraints, but rather ofcost and space considerations. In more advanced "virtual reality"systems, it is conceivable that there could be many thousands of soundpixels 12 incorporated into a sound reproducing surface that enclosesparticipants in a 360 degree sphere for complete realism in soundreproduction.

FIG. 4 is a block diagram illustrating the components of the soundreproducing surface 10 and its electronics, wherein playback occurs in astatic mode with responsive inputs. For example, one embodiment of theinvention would be to add input from remote sensors 50 which could be acontrol pad or joy stick, infrared sensors, ultrasound sensors, or otherapparatus well known in the art. The inputs from these remote sensors 50would be received at 52 and processed at 54 to provide select/enablesignals for determining which data streams are retrieved from a datastorage device 56. The data streams retrieved from the digital storage56 would be combined with or controlled or modified by the data streamsretrieved from the storage device 48.

FIG. 5 is a block diagram illustrating the components of the soundreproducing surface and its electronics, wherein playback occurs in adynamic mode with responsive inputs and real-time audio. For example,one embodiment of the invention would be to add digitized real-timeaudio 50 from one or more microphones. These real-time inputs 50, aswell as the inputs from the remote sensors 50, would be received at 60and processed at 62 to provide select/enable signals for determiningwhich data streams are retrieved from the data storage device 56.Further, processor 62 can generate local DSP control data and P channelsof real-time digital audio data streams. The data streams retrieved fromthe digital storage 48 and the storage device 56 could be combined withthe real-time audio data streams.

FIG. 6 is a block diagram illustrating the components andinterconnections of a plurality of sound reproducing surfaces. A masterprocessor 64 is interconnected to a plurality of playback systems andcontrols the interaction therebetween. The master processor 64 iscoupled to a local processor 66 controlling a particular array of soundpixels 12. Each local processor 66, in turn, is coupled to digital audioand control signal drivers 44, and digital audio storage 48.

FIG. 7 is a block diagram illustrating the components of a static soundpixel 12 .using global digital signal processing. The sound pixel 12receives digital audio data at a receiver 68 and control signals at areceiver 70. The digital audio receiver 68 processes and transforms thedigital audio signals into pulse code modulation (PCM) digital audio andtiming data. The control data receiver 70 processes the control signals,which are comprised of enable and synchronization data, and transmitsthe enable and synchronization signals to the D/A converter 72. The D/Aconverter 72 transmits a monaural analog audio signal to an amplifierand low pass filter (LPF) 74 for driving the transducer 76 of the soundpixel 12.

FIG. 8 is a block diagram illustrating the components of a dynamic soundpixel 12 using local digital signal processing. In this embodiment, alocal DSP 78 processes the digital audio data and control signals. TheDSP 78 transforms the digital audio signals and control data into PCMdigital audio and timing data, synchronization data, and enable data,for transmission to the D/A convertor 72.

FIG. 9 is a block diagram illustrating the components of a satellitenetwork for sound pixels 12. In this embodiment, digital audio andcontrol signals transmitted to "master" sound pixels 12 aresimultaneously provided to "satellite" sound pixels 12. Satellite soundpixels 12 include components 80 to alter or other process the datastreams transmitted to the master sound pixel 12. The satellite soundpixel 12 may alter characteristics such as gain, delay, or performfiltering of the data streams.

FIG. 10 is a block diagram illustrating the components of a satellitesound pixel 12 with analog signal processing. In this embodiment, thesatellite sound pixel 12 receives analog audio signals from the mastersound pixel at receiver 82. The analog audio signals are modified by adelay and volume control circuit 84. The delay and control circuit 84 iscontrolled by a manual adjust or by MIDI commands received by receiver86. The output of the delay and volume control circuit 84 is amplifiedand filtered at 74 before driving the transducer 76.

FIG. 11 is a block diagram illustrating the components of a satellitesound pixel 12 with analog signal processing. In this embodiment, alocal DSP 78 processes the digital audio data and control signalstransmitted to the master sound pixel. The DSP 78 transforms the digitalaudio signals and control data into PCM digital audio and timing data,synchronization data, and enable data, for transmission to the D/Aconvertor 72, amplifier and low pass filter 74, and transducer 76.

FIG. 12 is a block diagram illustrating the components of a satellitesound pixel 12 utilizing digital processing and having a MIDI interface.In this embodiment, MIDI commands received by a MIDI receiver 86 areused to control the delay and volume control circuit 84.

FIG. 13 is a block diagram illustrating the components of a satellitesound pixel 12 utilizing digital processing and having analog output toother satellite sound pixels 12. In this embodiment, a local DSP 78processes the digital audio data and control signals transmitted to themaster sound pixel 12. The control signals include satellite data,filtering data, and timing data. The DSP 78 transforms the digital audiosignals and control data into PCM digital audio and timing data,synchronization data, and enable data, for transmission to the D/Aconvertor 72. The output of the D/A converter 72 is used to drive theamplifier and low pass filter 74 and transducer 76, as well as beingshared with other satellite sound pixels 12 via analog drivers 88.

FIG. 14 is a block diagram illustrating the components of a satellitesound pixel 12 utilizing digital processing and having digital output toother satellite sound pixels 12. In this embodiment, the local DSP 78outputs filtered PCM digital audio and timing data to an AES/EBUformatter 90 and RS485 driver 92, as well as the D/A converter 72.

Sound Bubble

FIGS. 15A-15D are block diagrams illustrating various perspective viewsof a sound bubble 94 or sound tent constructed according to theteachings of the present invention. The walls of the sound bubble 94 areformed by the sound reproducing surface 10 of the present invention.Generally, the surface 10 will comprise a fabric incorporating variousnumbers of sound pixels 12. Moreover, the enclosure may include amonitor 96 for use in generating video images. The sound bubble 94 isprimarily intended as an enhancement to video games. Another embodimentwould incorporate the sound bubble 94 into a helmet or visor or othersimilar personal device.

FIGS. 16A and 16B show the left panel 98 and right panel 100 of thesound bubble 94, which can include a soft speaker configuration. Theleft panel 96 includes a super tweeter 102 and sub woofer 104. Betweenthe super tweeter 102 and sub woofer 104 are array elements or soundpixels 106-110 (also labeled as 1L, 2L, and 3L). The right panel 100also includes a super tweeter 112 and sub woofer 114 and array elementsor sound pixels 116-120 (also labeled as 1R, 2R, and 3R).

FIG. 17 shows the rear panel 122 of the sound bubble 94, which has onearray element or sound pixel 124 (also labeled as 1R) located between asuper tweeter 126, a sub woofer 128, and two flexible electricalconnection panels 130 and 132.

FIG. 18 shows the top panel 134 of the sound bubble 94, which has onearray element or stand pixel 136 located between two flexible connectionpanels 138 and 140 on each respective side of top panel 134. Theflexible connection panels 138 and 140 each have a front flap 142 and144 respectively located at an end.

FIG. 19 is a block diagram of the electronic components used to controlthe operation of the sound bubble 94. The input typically comprisesdigital audio input received from, for example, a CD-ROM or cartridgegame. The digital audio is fed into a digital receiver 146, whichprocesses and transforms the digital audio input into left data, rightdata, and word clock/bit clock. All data processed by digital receiver146 is sent to a decompression and oversampling device 148. Thedecompression and oversampling device 148 then processes and transformsthe left data, right data, and word clock/bit clock into an 8 bitdigital signal, which is sent to a routing device 150 which routes the 8bit digital signals to a filter bank 152. The filter bank 152 generateseight signals for the array elements, four supersonic signals for thesuper tweeters, and three subsonic signals for the sub woofers. Theeight signals for the array elements are sent to an amplifier and volumecontrol array 154, which also receives user volume control input. Theamplifier and volume control array 154 produces signals for the arrayelements or sound pixels 12. The four supersonic signals for the supertweeters and the three subsonic signals for the sub woofers are sent tosuper tweeter and sub woofer amplifier and volume control array 156,which also receives user volume control input. The super tweeter and subwoofer amplifier and volume control array 156 mixes the user volumecontrol input, supersonic signals, and subsonic signals and sends theresulting signals to the super tweeters and sub woofers.

Conclusion

This concludes the description of the preferred embodiment of theinvention. The foregoing description of the preferred embodiment hasbeen presented for the purposes of illustration and description. It isnot intended to be exhaustive or to limit the invention to the preciseform disclosed. Many modifications and variations are possible in lightof the above teaching. It is intended that the scope of the invention belimited not by this detailed description, but rather by the claimsappended hereto.

What is claimed is:
 1. A video game system, comprising:(a) a soundbubble comprising a deformable two-dimensional sound reproducing surfaceconfigured as an enclosure, wherein the surface is comprised of aplurality of sound pixels, the sound pixels comprise addressabletransducers for generating acoustical energy, and the sound pixels arearranged in an array having rows and columns so as to supportpropagation and movement of the acoustical energy along the rows andcolumns of the array; and (b) a computer, coupled to the sound bubble, amonitor and a data storage means, for interacting with an operator underthe control of a video game program, wherein the means for interactingcomprises means for retrieving at least one audio data stream from thedata storage means for each of the sound pixels, means for transmittingeach of the audio data streams to a specific sound pixel in the soundbubble, and means for modifying the audio data streams in response tothe input from the operator, wherein the sound pixels are synchronizedand interlinked by the audio data streams to reproduce a time line forthe acoustical energy source radiating and moving through the rows andcolumns of the array.
 2. The video game system of claim 1, furthercomprising means for creating a model of an acoustical playbackenvironment, means for creating a model of the acoustical energy sourcewithin the acoustical playback environment, and means for transformingthe model of the acoustical energy source into the audio data streams.3. The video game system of claim 1, further comprising means fordecomposing combined audio and video material into a plurality of theaudio data streams and at least one discrete video data stream, andmeans for storing the audio data streams and the video data stream onthe data storage means.
 4. The video game system of claim 1, wherein thecomputer further comprises means for retrieving the audio and video datastreams from the data storage means, means for controlling the soundpixels in response to the retrieved audio data streams, and means forcontrolling the monitor in response to the video data stream.
 5. Thevideo game system of claim 1, wherein the sound pixels each comprise afull range audio transducer that generates sound under control of theaudio data streams.
 6. The video game system of claim 1, wherein thecomputer further comprises means for modifying the audio data streams inresponse to external stimuli.
 7. The video game system of claim 1,wherein the computer further comprises means for accepting audio inputand for modifying the audio data streams in response thereto.
 8. Anaudio system, comprising:(a) a deformable two-dimensional soundreproducing surface, wherein the surface is comprised of a plurality ofaddressable transducers for generating acoustical energy, and thetransducers are arranged in an array having rows and columns so as tosupport propagation and movement of the acoustical energy along the rowsand columns of the array; and (b) a computer, coupled to the soundreproducing surface and a data storage means, for interacting with anoperator under the control of a computer program, wherein the means forinteracting comprises means for retrieving at least one audio datastream from the data storage means for each of the transducers, andmeans for transmitting each of the audio data streams to a specifictransducer, wherein the transducers are synchronized and interlinked bythe audio data streams to reproduce a time line for the acousticalenergy source radiating and moving through the rows and columns of thearray.
 9. The audio system of claim 8, further comprising means forcreating a model of an acoustical playback environment, means forcreating a model of the acoustical energy source within the acousticalplayback environment, and means for transforming the model of theacoustical energy source into the audio data streams.
 10. The audiosystem of claim 8, further comprising means for accepting audio inputand for modifying the audio data streams in response thereto.
 11. Theaudio system of claim 8, further comprising means for decomposingcombined audio and video material into a plurality of the audio datastreams and at least one discrete video data stream, and means forstoring the audio data streams and the video data stream on the datastorage means.
 12. The audio system of claim 8, further comprising amonitor coupled to the computer, and the computer further comprisesmeans for retrieving the audio and video data streams from the datastorage means, means for controlling the transducers in response to theretrieved audio data streams, and means for controlling the monitor inresponse to the video data stream.
 13. The audio system of claim 8,wherein the transducers each comprise a full range audio transducer thatgenerates sound under control of the audio data streams.
 14. The audiosystem of claim 8, wherein the computer further comprises dynamic modemeans for modifying the audio data streams in response to externalstimuli.
 15. A method of generating audio, comprising the steps of:(a)retrieving at least one audio data stream from a data storage devicecoupled to a computer, (b) transmitting each of the audio data streamsto a specific transducer of a deformable two-dimensional soundreproducing surface coupled to the computer, wherein the surface iscomprised of a plurality of addressable transducers for generatingacoustical energy, the transducers are arranged in an array having rowsand columns so as to support propagation and movement of the acousticalenergy along the rows and columns of the array, and the transducers aresynchronized and interlinked by the audio data streams to reproduce atime line for the acoustical energy source radiating and moving throughthe rows and columns of the array.
 16. The method of generating audio ofclaim 15, further comprising the steps of creating a model of anacoustical playback environment, creating a model of the acousticalenergy source within the acoustical playback environment, andtransforming the model of the acoustical energy source into the audiodata streams.
 17. The method of generating audio of claim 15, furthercomprising the steps of accepting audio input and modifying the audiodata streams in response thereto.
 18. The method of generating audio ofclaim 15, further comprising the steps of decomposing combined audio andvideo material into a plurality of the audio data streams and at leastone discrete video data stream, and storing the audio data streams andthe video data stream on the data storage device.
 19. The method ofgenerating audio of claim 15, further comprising the steps of retrievingthe audio and video data streams from the data storage device,controlling the transducers in response to the retrieved audio datastreams, and controlling a monitor coupled to the computer in responseto the video data stream.
 20. The method of generating audio of claim15, wherein the transducers each comprises a full range audio transducerthat generates sound under control of the audio data streams.
 21. Themethod of generating audio of claim 15, further comprising the step ofmodifying the audio data streams in response to external stimuli.